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Having thus described our invention, what we claim new and desire to 
secure by Letters Patent is as follows: 



\. A system for providing context based verbal commands to a multi-modal 

browser, comprising: 

a context-based audio queue ordered based on contents of a page being 

audibly read by the multi-modal browser to a user; 

a store for storing a current context of the audio queue; and 

a speech recognition engine for recognizing and registering voice 

commands, wherein said speech recognition means compares a current audio 

context with the context associated with a voice command and causes the 

browser to perform an action based on the comparison. 

2. The system as recited in claim 1, wherein the browser action comprises 
accessing a different Uniform Resource Locator (URL) and rendering a page 
specified by the URL. 

3. The system as recited in claim 1, wherein when a first tag is used to 
designate the audio context, recognized voice commands associated with the 
audio context are ignored unless an audio context has been established, and 
wherein if a context has been established, a Uniform Resource Locator (URL) 
is followed after appending the current context. 

4. The system as recited in claim 3, wherein said first tag is designated a 
REQUIRED tag. 
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5. The system as recited in claim 3, wherein when a second tag is used to 
designate the audio context, if a context is established, it is appended before 
driving the URL, and wherein if no context is established, the URL is 
followed without appending anything. 

6. The system as recited in claim 5, wherein the second tag is designated an 
OPTIONAL tag. 

7. The system as recited in claim 5, wherein when a third tag is used to 
designate the audio context, the context is not appended even if it is defined. 

8. The system as recited in claim 7, wherein the third tag is designated an 
IGNORE tag. 

9. The system as recited in claim 7, wherein when a fourth tag is used to 
designate the audio context, the command is driven only if a context is not 
defined. 

10. The system as recited in claim 9, wherein the fourth tag is designated an 
INVALID tag. 

1 1 . The system as recited in claim 1 , wherein the page being audibly read is a 
markup language page. 



r^A computer implemented method for providing context based verbal 
commands to a multi-modal browser, comprising the steps of: 

building a context based audio queue based on the contents of markup 
language page being audibly read by the multi-modal browser to a user; 
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5 storing a current context of the audio queue; and 

6 recognizing and registering voice commands, wherein the current 

7 audio context is compared with a voice command, thereby causing the 

8 multi-modal browser to perform an action based on the comparison. 

1 13. The computer implemented method for providing context based verbal 

2 commands to a multi-modal browser as recited in claim 12, wherein the 

3 browser action comprises accessing a different Uniform Resource Locator 

4 (URL) and displaying the contents of the URL. 

1 14. The computer implemented method for providing context based verbal 

2 commands to a multi-modal browser as recited in claim 12, wherein when a 

3 first tag is used to designate the audio context, recognized voice commands 

4 associated with the audio context are ignored unless an audio context has been 

5 established, and wherein if a context has been established, a Uniform 

6 Resource Locator (URL) is followed after appending the current context. 

1 15. The computer implemented method for providing context based verbal 

2 commands to a multi-modal browser as recited in claim 14, wherein said first 

3 tag is designated a REQUIRED tag. 

1 16. The computer implemented method for providing context based verbal 

2 commands to a multi-modal browser as recited in claim 13, wherein when a 

3 second tag is used to designate the audio context, if a context is established, it 

4 is appended before following the URL, and wherein if no context is 

5 established, the URL is driven without appending anything. 
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1 17. The computer implemented method for providing context based verbal 

2 commands to a multi-modal browser as recited in claim 16, wherein the 

3 second tag is designated an OPTIONAL tag. 

1 18. The computer implemented method for providing context based verbal 

2 commands to a multi-modal browser as recited in claim 16, wherein when a 

3 third tag is used to designate the audio context, the context is not appended 

4 even if it is defined. 

1 19. The computer implemented method for providing context based verbal 

2 commands to a multi-modal browser as recited in claim 18, wherein the third 

3 tag is designated an IGNORE tag. 

1 20. The computer implemented method for providing context based verbal 

2 commands to a multi-modal browser as recited in claim 18, wherein when a 

3 fourth tag is used to designate the audio context, the command is driven only 

4 if a context is not defined. 

1 21. The computer implemented method for providing context based verbal 

2 commands to a multi-modal browser as recited in claim 20, wherein the fourth 

3 tag is designated an INVALID tag. 
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